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1 The Collatz 3x + 1 problem 


The classical Collatz 3a; + 1 Problem can be formulated as follows. Let x be 
a positive odd integer. Consider the sequence 


Xo = X, 


Xn = 


^Xn-l + 1 
2 '^" ' 


n > 1, 


( 1 . 1 ) 


where 2'^’* is the highest power of 2 dividing 3xn-i + 1- Hence {a;„}^Q is 
a sequence of positive odd integers (if, e.g., a; = 1, then a;„ = 1 for all n). 
Notice that dn > 1 for all n > 1. 
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Suppose L := lira inf a;„ < cxo. Then, since Xn takes only positive integral 
values, we must have that Xn = L for inhnitely many values of n. In partic¬ 
ular, Xk = Xk+b = L for some A; > 0, 6 > 1. But, then, it follows from fll.ip 
that Xk+n = Xk+b+n for all integers n > 0. Therefore, either 

lima;„ = cxo, (1.2) 

n 

or the sequence {xn}'^=Q is eventually periodic, namely there is a 6 > 1 and 
an 77-0 > 0 such that 

Xn+b = Xn for all n > Uq. (1.3) 

Notice that, if 6 = 1, i.e. if there is a no such that Xn+i = Xn for all n > no, 
then fll.lll implies that (2'^"+^ — 3)xn = 1, which forces = 1 for all n > no. 
The Collatz 3x-M Problem pertains to the behavior of the sequence {x„}^q 
as n —)■ oo. One famous and longstanding open question is whether there 
exists some initial value x for which hm„a:„ = oo, while another open ques¬ 
tion is whether it is possible to have an eventually periodic behavior with a 
(minimal) period b > 1. 

The ultimate Collatz Conjecture is that, no matter what the initial value x 
is, we always have that = 1 for all n sufficiently large. Needless to say 
that the conjecture has beed verified for a huge set of initial values x. 

2 A randomized version of the problem 

Let a; be a positive odd integer. We consider the sequence 

= = „>i, (2.1) 

where is a sequence of independent and identically distributed (i.i.d.) 

random variables taking odd integral values > —1, and 2^^" is the highest 
power of 2 dividing 3X„_i -|- (notice that we again have dn > I for all 
n > 1). Thus, is now a random sequence of positive odd integers. 

Let us introduce the filtration 


J-o;={0,f2}, J-„:=a(6,...,en), n > 1, (2.2) 

where (hi, J^, P) is the underlying probability space. Clearly, by 02.111 we 
have that the random variables Xn and dn are J^„-measurable for all u > 1. 
Notice that 

P . (7(yX\^ • • • 7 Xn') d PXI and P^ • ^(dl, • • • , dn) d pnx Tl P 

(2.3) 
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Of course, 


(2.4) 


V 77. ^ 1 

where V denotes the a-algebra generated by and 
Formula fl2.ip implies that {X„}5 ^q is a Markov chain with respect to 
whose state space is the set Modd of positive odd integers. Actually, the two- 
dimensional process {{Xn, dn)}'^=Q can be also viewed as a Markov chain with 
respect to Xn (the value of do is irrelevant; furthermore, conditioning on d„ 
is irrelevant for (X„+i, d„+i)). 

The most natural case to examine hrst seems to be the choice P{^n = ~1} = 
P{^n = 1} = 1/2 (or P{^n = 1} = P{^n = 3} = 1/2). Here, however, we 
will consider the rather easier case 

P{^n = 1} = P{^n = 3} = P{^n = 5} = P{^n = 7} = ^- (2-5) 

To begin our analysis, let us observe that for any positive odd integral value 
of Xn-i we have 

{3X„_i + l, 3X„_i + 3, 3X„_i + 5, 3X„_i + 7} = {0,2,4,6} mod 8. (2.6) 
Therefore, due to fl2.5p and the independence of X„_i and we have 

F{3X„_i=/c mod 8} = - for /c = 0,2,4, 6. (2.7) 

The above formula motivates us to set 

rUn := 3 Adn, n > 1 (2.8) 

(as usual, a A b denotes the minimum of a and b), where dn is the random 
exponent appearing in dj. Then, fl2.ip . fl2.7p . the Markov property of 
(X„, dn), and the independence of X„_i and ^n imply 

P{mn = 1 1 Xn-i] = P{mn = 1 1 X„_i} = P{3Xn-i+ = 2 mod 4 I Xn-i} = ^ 

(2.9) 

for all n > 1. Likewise, 

P{m„ = 2 |X„_i} = = 3 |X„_i} = ^, n > 1. (2.10) 

Formulas fl2.9p and (12.1 Op tell us that rrin and Xn-i are independent for every 
n > 1. In particular (since is P„-measurable for all n > 1) we have that 
{mn}^^i is a sequence of i.i.d. random variables with 

P{mn = 1} = ^, P{mn = 2} = P{mn = 3} = ^. (2.11) 
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Proposition 1. Let odd-integer-valued Markov chain intro¬ 
duced in fl2.ip . where is a sequence of i.i.d. random variables whose 

common distribution is given by fl2.5p . Then, 

limsupX„ = oo a.s. (2-12) 

for any initial value Xq = x (as usual, “a.s.” stands for “almost surely”, i.e. 
“with probability 1”). 

Proof. Fix a constant K > 0 and then pick an integer fc > 1 so that 

k 

> K. (2.13) 

Since is a sequence of i.i.d. random variables whose common distri¬ 

bution is given by fl2.1ip . an immediate consequence of the 2nd Borel-Cantelli 
Lemma is that 



P{mn = rrin+i = ■■■ = rrin+k-i = 1 i-o.} = 1 (2.14) 

(“i.o.” stands for “infinitely often”, i.e. for infinitely many values of n). But, 
if nin = mn+i = ■ ■ ■ = rrin+k-i = 1, then, by fl2.ll) . fl2.8p . fl2.13l) . and the fact 
that (Xo = x>l and) X„, > 1 for every n > 1, we must also have that 

Xn+k > X„ > K. (2.15) 

Therefore, fl2.14p implies that 

P{X^+k > K i.o.} = 1. (2.16) 


From formula fl2.16p we get 


limsupX„ > K a.s. 

and since K is arbitrary, the proposition follows from the fact that 

OO 

{limsupXn = cxd} = {limsupXn > K}. 

K=1 


Remark 1. In the case P{fn = ~1} = P{f,n = 1} = 1/2 things are quite 
different since now 1 is an absorbing (or trapping) state, i.e. if X„ = 1 for 
some n, then Xn+k = 1 for all k > 0. Hence, fl2.15p and, consequently, fl2.12p 
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are not valid. In fact, since for any initial state x there is always a positive 
probability that = 1 for some n, it follows that P{limsupX„ = cxo} < 1. 
A natural open question here, in the spirit of the Collatz Problem, is 
whether P{limsupX„ = 00 } = 0. 

Let us now continue the analysis of the case 02.51) . Formula 02.ip can be 
written as 

Thus, in view of 02. 5 p and 02.8p we have 


1 < < 


1 + 


7 


3X„-i 


X. 


n—!• 


(2.18) 


Due to the multiplicative form of the formulas it is convenient to set 


y;:=lnX„, n > 0. (2.19) 

Then, inequality 02.18P is equivalent to 

0 <Yn < Yn -1 + In ^1 + + ln3 - m„ln2. (2.20) 

By 02.lip we have P[m„] = 7/4 (and V[mn] = 11/16). Thus 

P[ln 3 — TUn In 2] = In 3 — ~ f ~ ~0.1144. (2.21) 


Now, let us fix an e: such that 0 < £ < —P[ln 3 — In 2]. Then, it is easy to 
see that there is an M > 1 such that ln(l + (7/3)e“^) < e for all y > M. For 
example, if e = 1/10, then it suffices to take M = In 23. With such values of 
e and M, formula O2.20p implies 


0 <Yn < W_i + e: + In 3 — In 2, if W_i > M, (2.22) 

and 

0 < W < Yn-i + In 5, if Yn-i < M. (2.23) 

For notational convenience we prefer to write formula 02.221) in the form 

0 < W ^ Yn-l + Wn, if Yn-1 ^ M, (2.24) 

where 

IL/i := e + ln3 — m„ln2, n > 0. (2.25) 
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From the properties of it follows immediately that {Wn}'^=i is a 

sequence of i.i.d. random variables with 

/i := i?[hFn] =£ +i?[ln 3 — In2] < 0 (2.26) 

and, furthermore, that Y^-i and Wn are independent for every n > 1. 

The following proposition is in the spirit of the Collatz Conjecture. 
Proposition 2. Let {X„}^g be the Markov chain of Proposition 1. Then, 
the state 1 is positive recurrent [T]. In particular 

P{Xn = 1 i.o.} = 1 (2.27) 


for any initial value Xq = x. 

Proof. For an e and an M as above let 

Ni := inf{n > 0 : > M} and Di := inf{n > Ni : < M} 

(2.28) 

(if Yq = \n.x > M, then Ni = 0). Notice that Ni and Di are stopping 
times of the Markov chain {Yn}'^^Q and, hence, of the hltration By 

Proposition 1 we have that 

Ni < oo a.s. (2.29) 


Actually, much more is true. Since for any hxed fc > 1 we have that 


P{mn = = ■ ■ ■ = rrin+k-i = 1} > 0, 

it follows that there is an og > 0 such that 

< oo for all a < oq- (2.30) 


In particular. 


E[Ni] < oo. 


(2.31) 


Suppose now that u G {Di = oo}. Then, for such (u’s we must have 1^1+^ > 
M for all n > 0 and, hence, formula fl2.24p becomes 


Ym^+u+i - dvi+n < IFjVi+n+i, for all u > 0 


or 

n 

Yni+u — fovi < E Ifov^+j, for all n > 1. (2.32) 

j=i 

However, is a sequence of i.i.d. random variables whose common 

distribution is that of Wn [I]. In particular, the common expectation of 
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j > 1, is strictly negative. As a consequence of these facts we have 
that the event of fl2.32p has probability 0 and, furthermore, there is a /3o > 0 
such that 



E[e^^^] < oo for all (3 < /do- 

(2.33) 

In particular. 

E[Di\ < oo 

(2.34) 

and 

Di < oo a.s. 

(2.35) 

We can then introduce the stopping times 


Xfc := inf{n > Dk_i : > M}, '■= inf{n > Nj. : < M}, k >2 

(2.36) 

As in the case of Xi and Di, we again have that, there are cto > 0 and /do > 0 
independent of k such that, for all fc > 2 we have 

< cx). 

^[g/3^fc] QQ fQj. every a < ao, /d < /do. 

(2.37) 

In particular. 

E[Nk] < oo, E[Dk] < oo 

(2.38) 

and 

Nk < oo, Dk < oo a.s. 

(2.39) 


Let Om denote the set of odd positive integers which are less than (deh- 
nitely 1 G Om)- Then, the above analysis implies 


P{Xn 6 Om i-o.} — 1. (2.40) 

Since Om is a hnite set, some state r in Om niust be recurrent; actually 
positive recurrent due to fl2.38p [1]. But, then, since there is a nonzero 
probability for the Markov chain to go from any r G Om to 1, it follows 
that 1 is positive recurrent [1]. ■ 

The next proposition generalizes Proposition 2. 

Proposition 3. Let be the Markov chain of Propositions 1 and 2. 

Then, all states in Nodd are positive recurrent. 

Proof. By Proposition 2 we can assume without loss of generality that Xq = 
1. Then, we need to show that all states in Nodd can be reached by {X„}))To 
with nonzero probability. 

Let m be the smallest odd integer which cannot be reached, namely P{X„ = 
m} = 0 for all n > 1. By Proposition 2 we have that m > 3. Therefore, we 
should have one of the following three possibilities: 

m = 6k + 3 or m = 6k + 5 or m = 6k + 7 for some k > 0. 
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(i) Suppose m = 6k + 3 for some k > 0. Then, 4k + 1 < m and since 4k + 1 
is odd, we must have that P{X„ = 4fc + 1} > 0 for some n. But, then, since 

3(4A: + 1) + 3 = 12A: + 6 = 2(6fc + 3) = 2m, 

we should have by fl2.ip that P{X„+i = m} > 0, a contradiction. 

(ii) Next, suppose m = 6fc + 5 for some /c > 0. Then, 4fc + 3 < m and since 
4k+ 3 is odd, we must have that P{Xn = 4fc + 3} > 0 for some n. But, then, 
since 

3(4A; + 3) + 1 = 12A; + 10 = 2{6k + 5) = 2m, 

we should have by (ED that P{Xn+i = > 0, a contradiction. 

(iii) Finally, suppose m = 6fc + 7 for some k > 6. Then, 4A; + 3 < m and 
since 4fc + 3 is odd, we must have that P{Xn = 4A: + 3} >0 for some n. But, 
then, since 

3(4A; + 3) + 5 = 12fc + 14 = 2{6k + 7) = 2m, 

we should have by fl2.ip that P{Xn+i = m} > 0, again a contradiction. 
Therefore, in all three possibilities for m we have reached a contradiction. It 
follows that such an m cannot exist. ■ 

Remark 2. A side result of Proposition 3 is that the Markov chain {X„}^q 
is irreducible pQ. In the case where S,n takes the values 1, 3, and 5 only 
with positive probabilities, given Xq = 1, one can use the idea of the proof of 
Proposition 3 in order to show that the associated Markov chain is irreducible. 
However, it is an open question whether Proposition 2 is valid in that 
case. As for the case where takes only the values 1 and 3 with positive 
probabilities, given Xq = 1, even the irreducibility is an open question. 

Final Comments. Since P{Xn+i = 11 A^n = 1} = 1/2 > 0, it follows 
from Proposition 3 that the Markov chain is aperiodic [1]. Also, 

again by Proposition 3 we have that has a stationary distribution 

TT [1]. Finally, the existence of tt together with the aperiodicity (and the 
irreducibility mentioned in Remark 2) imply |T] that 

P{Xn = y\XQ = x} ^ 7r(|/) as n —)■ cxo, 

for every x,y E Modd- 
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